Developing Rating Scale Descriptors for Assessing the Stages of Writing Process: The Constructs Underlying Students' Writing Performances

Authors

Abstract:

The purpose of the present study is to develop appropriate scoring scales for each of the defined stages of the writing process, and also to determine to what extent these scoring scales can reliably and validly assess the performances of EFL learners in an academic writing task. Two hundred and two students’ writing samples were collected after a step-by-step process oriented essay writing instruction. Four stages of writing process —generating ideas (brainstorming), outlining (structuring), drafting, and editing —were operationally defined. Each collected writing sample included student writers’ scripts produced in each stage of the writing process. Through a detailed analysis of the collected writing samples by three raters, the features which highlighted the strong or weak points in the student writers’ samples were identified, and then the student writers’ scripts were categorized into four levels of performance which were holistically defined as VERY GOOD, GOOD, FAIR, and POOR. Then descriptive statements were made for each identified feature to represent the specified level of performance. These descriptive statements, or descriptors, formed rating scales for each stage of the writing process. And finally, four rating scales, namely brainstorming, outlining, drafting, and editing were designed for the corresponding stages of the writing process. Subsequently, the designed rating scales were used by the three raters to rate the 202 collected writing samples. The scores thus obtained were put to statistical analyses. The high inter-rater reliability estimate (0.895) indicated that the rating scales could produce consistent results. The Analysis of Variance (ANOVA) indicated that there was no significant difference among the ratings created by the three raters. Factor analysis suggested that at least three constructs, knowledge, planning ability, and idea creation ability —could possibly underlie the variables measured by the rating scale.

Upgrade to premium to download articles

Sign up to access the full text

Already have an account?login

similar resources

developing rating scale descriptors for assessing the stages of writing process: the constructs underlying students’ writing performances

the purpose of the present study is to develop appropriate scoring scales for each of the defined stages of the writing process, and also to determine to what extent these scoring scales can reliably and validly assess the performances of efl learners in an academic writing task. two hundred and two students’ writing samples were collected after a step-by-step process oriented essay writing ins...

full text

developing rating scale descriptors for assessing the stages of writing process: the constructs underlying students' writing performances

the purpose of the present study is to develop appropriate scoring scales for each of the defined stages of the writing process, and also to determine to what extent these scoring scales can reliably and validly assess the performances of efl learners in an academic writing task. two hundred and two students’ writing samples were collected after a step-by-step process oriented essay writing ins...

full text

Assessing Critical Thinking Ability via the Writing Process: Developing and implementing a Rating Scale

The present exploratory mixed methods study aimedto develop a scale for assessing critical thinking (CT) ability of Iranian EFL learners. The study wasconducted in three phases. In phase one, the features of CT components were examined in the writingsof 120 participants. A holistic and an analytic scale were developed based on their performance in exploiting the components of CT and the fea...

full text

the impact of portfolio assessment on iranian efl students essay writing: a process-oriented approach

this study was conducted to investigate the impact of portfolio assessment as a process-oriented assessment mechanism on iranian efl students’ english writing and its subskills of focus, elaboration, organization, conventions, and vocabulary. out of ninety juniors majoring in english literature and translation at the university of isfahan, sixty one of them who were at the same level of writing...

15 صفحه اول

the effect of audio-taped feedback and conferencing on efl students’ writing ability

: بازخورد یکی از جنبه ها ی ضروری هر دوره ی آموزشی نگارشی – زبانی انگلیسی می باشد که به زبان آموزان مهارت های مورد نیاز جهت بهبود توانایی نگارشی را می آموزد. این تحقیق، با استفاده از طرح پیش آزمون، پس آزمون، و پسا آزمون ، سعی دارد تا تأ?یر نوع بازخورد مدرس در کمک به زبان آموزان جهت بازنویسی نوشته هایشان رابررسی کند ، و آیا اینکه رابطه ای بین نوع بازخورد مدرس و توانایی زبان آموزان در تصحیح غلط ها...

My Resources

Save resource for easier access later

Save to my library Already added to my library

{@ msg_add @}


Journal title

volume 1  issue 1

pages  1- 18

publication date 2010-05-01

By following a journal you will be notified via email when a new issue of this journal is published.

Hosted on Doprax cloud platform doprax.com

copyright © 2015-2023